vmware: vm migration improvements #4385

shwstppr · 2020-10-06T09:26:20Z

Description

Fixes inter-cluster migration of VMs
Allows migration of stopped VM with disks attached to different and suitable pools
Improves inter-cluster detached volume migration
Allows inter-cluster migration (clusters of same Pod) for system VMs, VRs on VMware
Allows storage migration for stopped system VMs, VRs on VMware within same Pod if StoragePool cluster scopetype

Linked Primate PR: apache/cloudstack-primate#789 [Changes merged in this PR after new UI merge]
Documentation PR: apache/cloudstack-documentation#170

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)

Screenshots (if appropriate):

How Has This Been Tested?

UI and cmk

Signed-off-by: Abhishek Kumar <[email protected]>

shwstppr · 2020-10-06T09:32:51Z

@blueorangutan package

blueorangutan · 2020-10-06T09:33:59Z

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-10-06T10:02:59Z

Packaging result: ✖centos7 ✖centos8 ✖debian. JID-2122

Signed-off-by: Abhishek Kumar <[email protected]>

blueorangutan · 2020-10-07T13:14:22Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2144

shwstppr · 2020-10-07T13:45:06Z

@blueorangutan test

blueorangutan · 2020-10-07T13:45:59Z

@shwstppr a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

blueorangutan · 2020-10-07T22:58:27Z

Trillian test result (tid-2908)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31315 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4385-t2908-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
Smoke tests completed. 84 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_hostha_kvm_host_fencing	`Error`	175.17	test_hostha_kvm.py

Signed-off-by: Abhishek Kumar <[email protected]>

shwstppr · 2020-11-03T09:13:14Z

@blueorangutan package

blueorangutan · 2020-11-03T09:13:56Z

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-11-03T09:59:38Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2326

borisstoyanov · 2020-11-03T13:59:29Z

@blueorangutan test matrix

blueorangutan · 2020-11-03T14:00:02Z

@borisstoyanov a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

blueorangutan · 2020-11-04T01:31:37Z

Trillian test result (tid-3124)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 39695 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4385-t3124-vmware-65u2.zip
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
Smoke tests completed. 84 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_03_deploy_and_upgrade_kubernetes_cluster	`Failure`	772.99	test_kubernetes_clusters.py
test_02_list_snapshots_with_removed_data_store	`Error`	17.12	test_snapshots.py

blueorangutan · 2021-02-03T06:17:35Z

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2021-02-03T07:14:12Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2642

shwstppr · 2021-02-09T10:44:24Z

@blueorangutan test centos7 vmware-67u3

blueorangutan · 2021-02-09T10:45:02Z

@shwstppr a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

blueorangutan · 2021-02-09T22:03:48Z

Trillian test result (tid-3516)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 38875 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4385-t3516-vmware-67u3.zip
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_service_offerings.py
Smoke tests completed. 84 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_03_deploy_and_upgrade_kubernetes_cluster	`Failure`	784.06	test_kubernetes_clusters.py
test_04_change_offering_small	`Error`	5.29	test_service_offerings.py

shwstppr · 2021-02-10T04:32:37Z

packages for last test run were not having fix - c9c1d4a, hence change offering test failed

@blueorangutan package

blueorangutan · 2021-02-10T04:33:10Z

@shwstppr a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2021-02-10T05:31:19Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2668

shwstppr · 2021-02-10T16:21:40Z

@blueorangutan test centos7 vmware-67u3

blueorangutan · 2021-02-10T16:23:07Z

@shwstppr a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

shwstppr · 2021-02-10T19:04:28Z

@blueorangutan test

blueorangutan · 2021-02-10T19:05:13Z

@shwstppr a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

blueorangutan · 2021-02-11T03:47:17Z

Trillian test result (tid-3527)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 39354 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4385-t3527-vmware-67u3.zip
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Smoke tests completed. 85 look OK, 1 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_03_deploy_and_upgrade_kubernetes_cluster	`Failure`	797.16	test_kubernetes_clusters.py

blueorangutan · 2021-02-11T06:39:52Z

Trillian test result (tid-3530)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 39887 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4385-t3530-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 86 look OK, 0 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File

Release 4.16.0.0 introduced a feature for migrating system VM volumes (#4385). However, it was enabled only for VMWare. This PR intends to enable the feature for KVM too. Co-authored-by: GutoVeronezi <[email protected]>

Release 4.16.0.0 introduced a feature for migrating system VM volumes (apache#4385). However, it was enabled only for VMWare. This PR intends to enable the feature for KVM too. Co-authored-by: GutoVeronezi <[email protected]>

shwstppr added 5 commits October 2, 2020 02:46

vmware: migration improvements

ceb16c2

Signed-off-by: Abhishek Kumar <[email protected]>

ui changes

1fa0c79

Signed-off-by: Abhishek Kumar <[email protected]>

null hypervisor check

c41d5fb

Signed-off-by: Abhishek Kumar <[email protected]>

review changes

003af0e

Signed-off-by: Abhishek Kumar <[email protected]>

review changes

6aad7a7

Signed-off-by: Abhishek Kumar <[email protected]>

shwstppr added this to the 4.16.0.0 milestone Oct 6, 2020

shwstppr added component:api component:migration component:vmware labels Oct 6, 2020

shwstppr self-assigned this Oct 6, 2020

shwstppr mentioned this pull request Oct 6, 2020

vm: backend migration changes support apache/cloudstack-primate#789

Open

shwstppr added 2 commits October 6, 2020 16:52

fix

341a69f

Signed-off-by: Abhishek Kumar <[email protected]>

fixes

503ae44

Signed-off-by: Abhishek Kumar <[email protected]>

shwstppr mentioned this pull request Oct 9, 2020

server: Optional destination host when migrate a vm #4378

Merged

5 tasks

PaulAngus added the type:enhancement label Oct 29, 2020

Merge branch 'master' into vmware-migration-improvements

d2a2ec5

Signed-off-by: Abhishek Kumar <[email protected]>

ACSGitBot added the status:wip label Nov 3, 2020

shwstppr requested a review from sureshanaparti February 4, 2021 13:43

yadvr approved these changes Feb 9, 2021

View reviewed changes

yadvr closed this Feb 9, 2021

yadvr reopened this Feb 9, 2021

shwstppr closed this Feb 10, 2021

shwstppr reopened this Feb 10, 2021

yadvr approved these changes Feb 12, 2021

View reviewed changes

yadvr merged commit d6e8b53 into apache:master Feb 12, 2021

shwstppr mentioned this pull request Mar 18, 2021

VMware: VM operations fail after inter-cluster storage migration #4838

Closed

shwstppr mentioned this pull request Apr 8, 2021

vmware: fix inter-cluster stopped vm and volume migration #4895

Merged

12 tasks

shwstppr mentioned this pull request Jun 8, 2021

Prevents null pointers when doing consecutive VM migrates #4282

Closed

5 tasks

weizhouapache mentioned this pull request Jul 22, 2021

Migration not working in ACS 4.14 with Basic Network - VMware Local storage #4187

Closed

shwstppr mentioned this pull request Jul 27, 2021

Improve volume migration without using secondary storage if possible #3404

Closed

GutoVeronezi mentioned this pull request Apr 29, 2022

Enable system VM volume migration for KVM #6341

Merged

6 tasks

vmware: vm migration improvements #4385

vmware: vm migration improvements #4385

Uh oh!

Conversation

shwstppr commented Oct 6, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Types of changes

Screenshots (if appropriate):

How Has This Been Tested?

Uh oh!

shwstppr commented Oct 6, 2020

Uh oh!

blueorangutan commented Oct 6, 2020

Uh oh!

blueorangutan commented Oct 6, 2020

Uh oh!

blueorangutan commented Oct 7, 2020

Uh oh!

shwstppr commented Oct 7, 2020

Uh oh!

blueorangutan commented Oct 7, 2020

Uh oh!

blueorangutan commented Oct 7, 2020

Uh oh!

shwstppr commented Nov 3, 2020

Uh oh!

blueorangutan commented Nov 3, 2020

Uh oh!

blueorangutan commented Nov 3, 2020

Uh oh!

borisstoyanov commented Nov 3, 2020

Uh oh!

blueorangutan commented Nov 3, 2020

Uh oh!

blueorangutan commented Nov 4, 2020

Uh oh!

blueorangutan commented Feb 3, 2021

Uh oh!

blueorangutan commented Feb 3, 2021

Uh oh!

shwstppr commented Feb 9, 2021

Uh oh!

blueorangutan commented Feb 9, 2021

Uh oh!

blueorangutan commented Feb 9, 2021

Uh oh!

shwstppr commented Feb 10, 2021

Uh oh!

blueorangutan commented Feb 10, 2021

Uh oh!

blueorangutan commented Feb 10, 2021

Uh oh!

shwstppr commented Feb 10, 2021

Uh oh!

blueorangutan commented Feb 10, 2021

Uh oh!

shwstppr commented Feb 10, 2021

Uh oh!

blueorangutan commented Feb 10, 2021

Uh oh!

blueorangutan commented Feb 11, 2021

Uh oh!

blueorangutan commented Feb 11, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

shwstppr commented Oct 6, 2020 •

edited

Loading